The Carnot Cycle for Small Systems: Irreversibility and the Cost of Operations 
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In the thermodynamic limit, the existence of a maximal 
efficiency of energy conversion attainable by a Carnot cycle 
consisting of quasi-static isothermal and adiabatic processes 
precludes the existence of a perpetual machine of the second 
kind, whose cycles yield positive work in an isothermal envi- 
ronment. We employ the recently developed framework of the 
energetics of stochastic processes (called 'stochastic energet- 
ics'), to re-analyze the Carnot cycle in detail, taking account 
of fluctuations, without taking the thermodynamic limit. We 
find that both in this non-macroscopic situation, both pro- 
cesses of connection to and disconnection from heat baths 
and adiabatic processes that cause distortion of the energy 
distribution are sources of inevitable irreversibility within the 
cycle. Also, the so-called null-recurrence property of the cu- 
mulative efficiency of energy conversion over many cycles and 
the irreversible property of isolated, purely mechanical pro- 
cesses under external 'macroscopic' operations are discussed 
in relation to the impossibility of a perpetual machine, or 
Maxwell's demon. This analysis may serve as the basis for 
the design and analysis of mesoscopic energy converters in 
the near future. 
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I. INTRODUCTION 

A. Background 

The principles of thermodynamics were established in 
the last century as the universal laws characterizing the 
thermal and mechanical behavior of macroscopic sys- 
tems. The fact that we cannot control all the details 
of energy transfer leads to the concept of heat as a form 
of energy flow, and the Carnot cycle has played a cru- 
cial role in the course of investigation leading to the in- 
troduction of entropy as a state variable in addition to 
energy Q. On the other hand, Brownian motion and 
the stochastic dynamics of mesoscopic systems in gen- 
eral have also been studied for many years, and projec- 
tion methods have allowed for the derivation of Langevin 
dynamics from microscopic Hamiltonian mechanics. In 



a properly defined Langevin equation, the influence of 
the unpredictable microscopic dynamics, which essen- 
tially represent the heat, is taken into account by Marko- 
vian random forces obeying the fluctuation-dissipation 
relationship. In this manner, such an equation describes 
the canonical equilibrium distribution of the variables in 
question 

Very recently, the concept of the heat on meso- 
scopic scales has been unambiguously defined in terms 
of Langevin dynamics j| . We refer to the formalism pro- 
viding this definition as stochastic energetics. .The essen- 
tial point of the thinking behind this formalism is that 
the heat transfered to the system is nothing but the mi- 
croscopic work done by both frictional forces and the 
random force in the Langevin equation. The theoreti- 
cal framework resulting from this realization widens the 
scope of application of Langevin dynamics to the extent 
that it can be used to describe not merely equilibrium 
states of system in contact with heat baths, but also gen- 
eral thermodynamic processes connecting different equi- 
librium states. As a result, we can derive the first and 
the second laws of thermodynamics HQ from stochas- 
tic energetics. This formalism, together with projection 
methods, bridge a longstanding gap between microscopic 
Hamiltonian mechanics and macroscopic thermodynam- 
ics. In this paper we apply the method of stochastic ener- 
getics to the investigation of the Carnot cycle in the con- 
text of small systems. To make this paper self-contained, 
we briefly summarize the framework of stochastic ener- 
getics in § |l| 

Stochastic energetics has also been applied to the study 
of thermodynamic processes under non-equilibrium con- 
ditions, such as processes including two heat baths || 
and processes in the presence of steadily driving forces 
Q. In particular, Feynman's ratchet model || has been 
analyzed. Regarding this model, the doubt has been cast 
by Parrondo , and later by Sekimoto ||] independently, 
about the attainability of reversible energy conversion 
with the 'Carnot efficiency' 1 — Tl/Th, where Tl and Th 
are the temperatures of cool and hot heat baths. Anal- 
ysis using stochastic energetics has shown explicitly that 
the efficiency of Feynman's ratchet is much less than that 
of the Carnot efficiency mentioned above [B| . 
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B. Problems 



we study in detail in the later sections. 



With the descriptive power of stochastic energetics in 
hand, we wish to reconsider the Carnot cycle. We con- 
sider the Carnot cycle as an object of analysis within the 
theoretical framework of stochastic energetics. Note that 
since we can derive the laws of thermodynamics directly 
using the stochastic energetics based on the Langevin 
description, the role of the Carnot cycle in our study is 
not a source of theoretical results from which one derives 
the laws of thermodynamics as was its historical role. (Of 
course both the Langevin description and thermodynam- 
ics have a microscopic basis in mechanics.) 

We now describe our viewpoint in more detail. Usu- 
ally the Carnot heat engine is considered in an ide- 
ally macroscopic context, working in the thermodynamic 
limit. There, the small relative fluctuations of the vari- 
ables, typically on the order of the inverse square root 
of the system size, are neglected. Also, the cost involved 
in the operations of attaching/detaching the system un- 
der study to/from heat baths is neglected, since this is 
not an the extensive quantity. It is important to notice 
that the second law of thermodynamics, which is con- 
sistent with such a macroscopic Carnot engine, can ex- 
clude only marginally the existence of perpetual machine 
of the second kind whose cycles yield positive work in 
an isothermal environment. Thus we may gain a deeper 
insight into the nature of statistical thermodynamics and 
mechanics if we can formulate a method to take account 
of the finiteness of the the system under study as well as 
the cost involved in operations of changing its interaction 
with heat baths, in particular considering reversibility 
and the second law of thermodynamics. 

The approach of the present work is to construct the 
simplest model of the Carnot heat engine with a finite 
number (actually only three) of degrees of freedom, in- 
cluding the apparatus connecting/disconnecting it with 
heat baths, and to determine the effect of the finiteness 
of the system and the change resulting from operations 
of the type mentioned above. As the system of study 
(or the 'working material') we choose a single harmonic 
oscillator. We show that there is an inevitable source of 
dissipation due to the intrinsically irreversible nature of 
the operations of connecting and disconnecting it with 
heat baths, and that, with the exception of such loss, our 
model can attain the Carnot maximal efficiency defined 
as a properly defined average over infinitely many cy- 
cles, each of which is performed infinitely slowly. At the 
same time this study reveals several basic problems which 
should be further scrutinized in the future: one regards 
the smooth connection between the adiabatic process and 
the isothermal processes, and the other regards the irre- 
versibility of adiabatic processes. In the last section we 
discuss these problems as well as the problem involving 
energy conversion with no help from external operations. 

In the remaining part of this section we give a quali- 
tative description of the aspects of the Carnot cycle that 



1. The operations of connection to and disconnection from 
the heat bath. 

We ask first how we can describe mechanically the con- 
nection and disconnection of the system with the heat 
baths. In an idealized picture, this basically consists of 
the switching on and off of the interaction between the 
system and each heat bath. In § [II we describe explic- 



itly a model that realizes these operations. We represent 
the influence of the heat baths by a frictional force and 
the random force of a Langevin equation, and we control 
the strength of the coupling between the system and the 
heat baths by controlling the values of the corresponding 
interaction potentials. We call these interaction poten- 
tials 'couplers'. (In an actual mechanical system, the 
control of such a coupler could be exercised by a system 
of clutches.) 

One could also imagine such control exercised through 
the change of the friction constants that appear in the 
Langevin equation. In consideration of the absence of 
a definition of the required work to change these fric- 
tion constants, however, this idea is not pursued in the 
present paper. . 

2.The reversible and irreversible work of operating the cou- 
plers 

The operation of the couplers can, in principle, never be 
carried out quasi-statically, but, at the same time, that 
accompanying irreversible work can be made arbitrar- 
ily small. The former part of this assertion is based on 
the following argument: When the interaction between 
the system and a heat bath is strong, the energy trans- 
fer between them occurs with a short relaxation time. 
However, if we gradually weaken this interaction, this re- 
laxation time increases more and more until it diverges 
when the system is completely detached from the heat 
bath. As long as the time-scale of the operation (i.e. the 
switching-off) is finite, this operation can never remain 
'slow' in comparison to the diverging relaxation time. 
Thus the switching-off process is by no means quasi- 
static, or quasi-equilibrium. (This is analogous to the 
non-adiabaticity encountered in chemical reactions; the 
Born-Oppenheimer approximation is inevitably invalid 
when the distance between nuclei is neither sufficiently 
large nor sufficiently small.) Inevitable irreversibility can 
also exist in the process of strengthening the interaction 
between the system and the heat bath. Such extreme 
strengthening of the interaction leads to the freezing of 
some degree(s) of freedom involved in the interaction, 
and the mean first-passage time associated with these de- 
grees of freedom may become larger than the timescale 
of the operation (i.e. the strengthening). In such a situ- 
ation also, the operation can never be carried out quasi- 
statically. Unlike the switching-off process, however, the 
indefinite strengthening of the interaction is not neces- 
sarily a part of the Carnot cycle. Despite this fact, we 
consider the latter process in the sections that follow, be- 
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cause this allows us to minimize the calculations needed 
to reach a general conclusion. 

We should, however, note that the inevitably irre- 
versibile nature of the operations described above does 
not necessarily impl y a n associated large amount of irre- 
versible work. In § |V| we analyze the work involved in 
operating the coupler and show that the amount of irre- 
versible work resulting from these inevitably irreversible 
operations can be made arbitrarily small in the limit that 
the timescale of the operation becomes large. We also 
show that the reversible part of the work associated with 
these operations remains finite in this limit, but that it 
cancels out within a cycle. 



5.The condition for reversible contact between the system 
and a heat bath 

Temporarily putting aside the concept of irreversibility 
in the sense described in 2 above, we can scrutinize the 
remaining part of the cycle and ask if and how the Carnot 
maximum efficiency can be attained. With regard to a 
macroscopic Carnot cycle, according to textbook descrip- 
tions, in order to realize a reversible cycle, 'the tempera- 
ture of the system should be the same as that of the heat 
bath with which the system is to make contact after an 
adiabatic process.' Strictly speaking, however, the en- 
ergy, rather than the temperature, takes a definite value 
in a thermally isolated system, and the above statement 
needs to be refined in terms of the language of proba- 
bility. We argue in § ^ that reversible contact requires 
the probability distribution of the energy of the system 
just before interaction with a heat bath to be identical 
to the canonical distribution at the temperature of the 
heat bath. This condition can be satisfied if the system 
consists of harmonic oscillators, as the model described 
below. Generally, however, this is not the case, and in 
the general situation an irreversible process takes place 
when system contacts the heat bath, even though there 
oc curs no net ir revers ible energy transfer between the two 
VILA). In § VIA we summarize the necessary condi- 



( . 

tions for Carnot cycle to realize the maximal efficiency 
1 — Th/Tl without assuming the thermodynamic limit. 
We show at the same time that this actually is the case 
for the model described in S III. 



4- Statistics of the efficiency of a finite number of cycles 

The efficiency of the energy conversion of an individual 
cycle is statistically distributed, because the energy pos- 
sessed by the system is different each time the system 
is disconnected from a heat bath. This fact reflects the 
indeterminate nature of the details of the microscopic 
states of the system and of the heat bath upon disconnec- 
tion. As a consequence, if we define the cumulative 'bonus' 
work as the difference between the cumulative work ob- 
tained over n cycles and what we would expect from 
the Carnot maximal efficiency, this bonus work takes the 
form of a discrete random walk as a function of n. We 
show in § VI B and the Appendix that the so-called null- 



insures that, although, if we actually carry out a se- 
quence of these cycles, the cumulative bonus work we 
obtain will with probability 1 first become positive after 
a finite number of repetitions n*, the statistical average 
of n* is infinite. 

5. Irreversibility of adiabatic processes 

The Carnot cycle includes an adiabatic process that is 
purely mechanical. We are interested in determining 
what work can be obtained through the cycle including 
non-quasi-static adiabatic processes. If the efficiency in 
this case is increased in comparison to the quasi-static 
case, the existence of a perpetual machine of the second 
kind is inspired, because our Carnot cycle can attain the 
maximal (reversible li mit) efficien cy und er certain con- 



ditions specified in § VIA. In § VII B we show that, 



in relation to the impossibility of a perpetual machine, 
there emerges the concept of the irreversibility of purely 
mechanical processes (with no assumption of the ther- 
modynamic limit or mixing properties necessary) under 
the influence of 'macroscopic' operations by an external 
agent. Here, designation of an operation as 'macroscopic' 
implies that (i) we are ignorant of the initial phase point 
on a given energy surface, and (ii) we are interested only 
in the statistical average over such an initial ensemble at 
a given energy. 



II. BRIEF SUMMARY OF STOCHASTIC 
ENERGETICS 

We consider a Langevin equation that represents a sys- 
tem in contact with a heat bath at temperature T, 



dx 

~dl 

dp 

~di 



P_ 

m 

-7; 



dU(x, a) 
dx 



£(*)■ 



(i) 



Here we denote by x and p the dynamical variable of the 
system and its conjugate momentum, while m represents 
the mass, 7 the friction constant, and U the potential 
energy for x. We assume that U may depend on, in 
addition to x, the variable (or variables) a, which is con- 
trolled by an external agent (or agents). The function 
£(i) represents, as usual, Gaussian white noise obeying 
the relations (hereafter we adopt units in which fee = 1) 



«(«)) =0, mm 1 )) = 2 7 T6(t-t'). 



(2) 



The second relation (Einstein's relation) insures a canon- 
ical distribution of x and p at temperature T if the pa- 
rameter a is held fixed for an infinitely long time. 

Multiplication of each term in the second equation in 
(0) by the displacement dx yields the equation || 



d_ 

dt 



P 

2m 



dt 



-7- + m dx 

m 



dU(x, a) 
dx 



dx, (3) 



recurrence property of a one-dimensional random walk 



where we have used the first equation of Eq.(Q) and 
also the identity ^dx = ^ij^dt. We note that 
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— (— 7^ff + is the reaction force exerted by the sys- 
tem against the heat bath, since the frictional force — 7^f 
and the random force are both due to the heat bath. 
We identify the work done by the reaction force as the 
heat transferred from the system to the heat bath, which 
we denote by (— dQ) H: 



-dQ 



(4) 



(The minus sign in front of dQ is included to conform 
to the convention of thermodynamics textbooks.) The 
key point of introducing the concept of heat is that, al- 
though the heat bath is idealized and not affected by the 
system's dynamics, the heat bath can still be subject to 
a reaction force exerted by the system. Adding the to- 
tal differential dU to both sides of Eq.(^), we obtain the 
general expression for the energy balance as 



P 

2m 



l)=^da- 
da 



dQ. 



(5) 



Now, because the l.h.s. is the total increase of the energy, 
and dQ is the energy input to the system as a heat, the 
first term on the r.h.s. of Eq.(||) must be identified as the 
work done by the external system, dW, on the system 
through the change of the variable a, 



dW 



dU 
da 



da. 



(6) 



We conclude that the law of energy balance expressed as 



dE = dW + dQ, 



E 



P 

2m 



U 



(J) 



is satisfied for any single realization of the stochastic pro- 
cess described by Eq.(0). 

For a quasi-static process, in which |^| | is arbitrarily 
small, the work is reversible and is equal to the change 
in the Hclmholtz free energy F(T,a) with probability 1. 
That is, in an ensemble of infinitely many realizations of 
such a process, the probability distribution of the work 
becomes a point distribution concentrated at the value 
of F(T, a). 



values, and its empirical distribution becomes asymptot- 
ically equal to the canonical distribution, P eq (x;T,a) — 

exp F ( T -°)~- E _ (The exception here is the case in which 

the interval [a, a + da] includes a po int at which the equi- 
libration time diverges. See 2 of § [B and § [V below.) 



We can then evaluate ^da using its average with respect 
to P cq in the quasi-static limit. Using the identity, 



oa 



dF(T,a) 
da 



(T fixed), (10) 



we reach the result Eq. (||) . 

In fact Eq.(^) is a stronger statement than the usual 
second law of thermodynamics for extensive systems, 
Note that for a thermodynamic system constituted by 
an ensemble of a large number of independent stochastic 
systems obeying Eq.p), the first law of thermodynamics 
is obtained from Eq.(ffl), 



{dE) = (dW) + (dQ), 



(11) 



and the second law of thermodynamics for quasi-static 
processes is obtained from Eq. (0) 0,0| , 



(dW) = dF(T,a), 



(for a quasi-static process with T fixed). 

(12) 



These relations are concerned with only the ensemble av- 
erages denoted by (•). It has also been shown Q that, 
for a finite rate of change of a(t), the Clausius inequality 



(dW) > dF(T,a) 



(13) 



holds, and an explicit formula for the irreversible work, 
(dW) — dF(T,a), has been obtained up to the second 
order in da/dt. 



III. MODEL 



dW = dF(T, a) 



Figure [l] schematizes the idea of our model. We em- 
ploy a single harmonic oscillator with mass m and spring 
constant k (> 0) as the system under study, which we call 
simply the "system" . We denote by x and p the position 
and momentum of the system, correspond to compress- 
or a quasi-static process with T fixed)j ng [decompressing] the ideal gas. Below, we consider k 



with 



F(T, a) = -T log 



'dxdp 



(8) 



(9) 



The derivation of Eq.(g) is as follows. We first note that, 
for a to change by any small but finite amount da, it 
takes a time |da|/|4f|, which is indefinitely large in the 
quasi-static limit. During this time interval the state 
point (x,p) comes arbitrarily close to almost all possible 



to be a quantity that can be controlled, as the volume of 
a gas system is controlled in macroscopic Carnot cycles. 

In order to allow independent and variable interaction 
with each heat bath, we represent each such interaction in 
the form of a mechanical force, which subsumes the cor- 
responding frictional and Gaussian random forces. Such 
mechanical forces should be related in some way to the 
degrees of freedom that directly interact with the heat 
baths, which we denote by j/h and j/l- For simplicity, 
we do this by writing the mechanical forces as interac- 
tion forces, — and — ^$*r. As interaction potentials, 
we choose functions 0h(x — j/h,Xh) and <ph{x — J/l,Xl), 
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where xh and XL are the control parameters. We call 
0h and 0l the 'couplers', because their values directly 
indicate the strength of the coupling between the system 
and the respective heat baths. We use the expressions 
like 'control the coupler(s)' in reference to changes made 
in the values of these control parameters. We assume that 
the functions 4> a (a=H, L) are 27r-periodic functions of 
x — y a . (See, for details, § IV and Fig. ||[) 



T 

> 


< 









FIG. 1. Schematic view of a Carnot heat engine. The 
spring and the shaded linear 'gear' represent the harmonic 
oscillator as the "system." The left end of the spring (the 
black box) is fixed. Heat baths of temperatures Th and 
Tl (the square shaded boxes) exert forces on the vanes (the 
star-shaped symbols inside the heat baths) whose angles of 
rotation are denoted by j/h and j/l, respectively. These vanes 
are tightly connected to the circular gears. These circular 
gears can interact with the system in a manner that depends 
on the control parameters xh and xl of the couplers. 

The degrees of freedom j/h and j/l are subject to the 
frictional forces — Ju^r and — jL^jr and the random 
forces £h(£) and £l(£) exerted by the heat baths at tem- 
peratures Th and Tl, respectively, as well as the interac- 
tion forces from the system, — (9</>h/<9j/h and —d(f>h/dyh- 
Here, 7h and 7l are the friction constants, and £h(£) 
and are the white Gaussian random forces sat- 

isfying <&(*)&(*')> = 2 7 HT H( 5(t - t% (&(*)&(*')) = 
2~f h T h 6(t -t'),& nd (£ h (*)£l(*0) = 0. The equations of 
motion for x, p, j/h, and j/l are given as follows: 



dx 



gears are 'disconnected' (i.e. completely disengaged) for 
Xa = 0, that is, 4> a {x — y a , 0) = 0. We have neglected the 
inertia effect related to j/h and j/l, as they would play 
only secondary role for our analysis. 

The protocol by which we control the parameters is 
represented in the space of (k,xn,Xh) as shown in Fig. 
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FIG. 2. The cycle undergone by the control parameters. 
The various legs of this cycle correspond to the following pro- 
cesses of the system: isothermal processes (Bh — > Ch and 
Dl — > Al), adiabatic processes (Ao — > Bo and Co — * Do), 
and the remaining processes where only one of the two control 
parameters of the couplers is changed (i.e. xh exclusively 
or xl 7^ 0) while k is kept constant. 

In the figure, the paths along the axis (xh,Xl) = (0,0) 
correspond to the adiabatic processes, while the verti- 
cal paths with (Xh,Xl) = (1,0) and (xh,Xl) = (0,1) 
correspond to the isothermal processes. The values of 
k corresponding to these four horizontal paths are the 
parameters. 



IV. REVERSIBLE AND IRREVERSIBLE WORK 
OF OPERATING THE COUPLERS 



dp 

a 



-kx 



d(j>K c% 



dx 



7h- 



dya dfa 



dt 



dim 



dx 



•&(*), 



dyh <90l . t 



dt 



dyh 



(14b) 



(14c) 



(14d) 



We consider the gears of the heat bath and the sys- 
tem to be 'tightly connected' (i.e. completely engaged) 
f° r Xa — 1, that is, the interaction <fi a (x — y a , 1) is so 
strong that the difference x—y a is fixed except for a small 
thermal fluctuation around its mean value, while these 



As we discussed in [|, the operation of the couplers can 
never be made quasi-static, because the time-scale of this 
operation inevitably becomes shorter than the equilibra- 
tion time for the system when the coupling between the 
system and a heat bath becomes either absent or ex- 
tremely tight. In addition to the work due to these irre- 
versible processes, there is also reversible work associated 
with operation of coupler. 

Figure || illustrates the generic features of the potential 
0q( 2 ,Xq) f° r three different values of Xa- Here 4>o, 
and represent the height of each potential profile. We 
assume that the height of 4> a {z,Xa) is a monotonically 
increasing function of Xa and satisfies max z <j>(z, 0) = 0, 
max z 0(z,Xao) = $o (< T a ), max 2 0(z,x Q i) = $i (> 
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T a ), and max z <j>{z, 1) = $00 (> $1) with < XaO < 
Xai < 1- 




Jt 2ji 

FIG. 3. The profiles of the interaction potential <p a are 
given as functions of z = x — y a for the three typical 
values of the maximum of cf> a , $0, $1 and <3>oo, where 
$0 < T a < $1 < $oo (see the text). 

There are two situations in which the time-scale of 
measurement and/or operation cannot exceed the equi- 
libration time of the system. One is when the height 
of 4> a is very small, and the other is when the height 
of cf> a is very large. Let us assume that the regime 
< Xa < XaO corresponds to the former case; that is, 
for max z 4> a {z, Xa) < ^o, the interaction cj> a is so weak 
that the equilibration time of the system with the heat 
bath (T = T a ) is beyond the timescale of measurement 
and/or operation. We call this the loose regime. Then, 
we assume that the regime Xal < Xa < 1 corresponds to 
the latter case; that is, for max z 4> a (z,x a ) > $1, the in- 
teraction 4> a is so strong that the equilibration time char- 
acterized by the over-barrier transition of z (see Fig ||) is 
again beyond the timescale of measurement and/or op- 
eration. In particular, we assume that for Xa = 1 there 
occur essentially no thermal activation events over the 
barrier $00. We call this the tight regime. In the re- 
maining regime, XaO < X» < Xai we assume that the 
operation can be carried out in a manner that arbitrar- 
ily closely approximates the quasi-static limit. Note that 
what Kramers calls the 'small viscosity' and 'large vis- 
cosity' cases in Ref. correspond, respectively, to the 
limits of the loose and tight regimes. 

We now evaluate the work 



W a (Xal^Xa2) 



d(j> a (x{t)-y a (t), Xa(t)) 

■a d Xa 



dXa(t), 



(15) 

for the loose and tight regimes using Eq.(^|). We will 
describe the case of a =H for concreteness. (The case of 
a =L can be treated similarly.) In the loose regime (the 
processes near B and C in Fig. ||), Wh(0 — > xho) is of 
order $0 and is small (<C Ta), although this work may 
be mostly irreversible. Since $0 is associated with the 
lower limit of quasi-static operation, the timescale of the 
operation is required to be large enough to satisfy the 
condition $ -C T H . 



In the tight regime (the processes near Bn and Ch in 
Fig. ||), the situation is more subtle. The contribution to 
Wh(xhi — * 1) consists of (i) the contribution produced 
when z moves around the valley regions of 0h {z, xh) with 
</>h $1 and (ii) the contribution produced when z vis- 
its, by rare thermal excitation, the barrier regions of 0h ■ 
To simplify the analysis we exclude the former contribu- 
tion by assuming that <90h(z, Xh)/<9xh = for z in the 
valley regions of 4>a (Fig. □) in the tight regime. (This 
assumption is only technical; one can reach the conclu- 
sion of this paragraph without it.) The evaluation of 
the contribution (ii) above is carried out as follows. The 
probability to find z in the barrier region is ~ e - * 1 /" 7 ", 
and for such values of z, the change of xh from xhi to 
1 results in an amount of work ~ ('I'oo — 3>i)- Thus we 
have Wn(xm 1) ~ e"*^^ - $ x ) ~ e^/^. 
Because the timescale of operation is sufficiently large to 
allow large values of $1. For this reason, the conditions 
e-* l/T *oo < T and $oo > T can be satisfied simultane- 
ously. In conclusion, the irreversible part of the work as- 
sociated with both the loose regime and the tight regime 
can be made as small as we wish by making the timescale 
of the operation sufficiently long in these regimes. The 
same conclusion holds for the case of a = L. 

The quasi-static work associated with the change of 
Xa within the region XaO < Xa < Xai can be evalu- 
ated using Eq.(|J). Below we show that such quasi-static 
work cancels exactly when summed over the consecutive 
operations of connection and disconnection with a heat 
bath. Again, considering the case of a = H, we denote 
by F(Ta, k, xh, 0(= xl)) the Helmholtz free energy of 
the composite system of the harmonic oscillator and the 
couplers, {p, x, j/ H , Vl}- 



-F(T H ,k,XH,0)/T H = 2lT 



dp 



tlx 



exp 



1 



p kx 

^ 1- -z- + M x - 2/H,Xh) 

2m 2 



(16) 



Note that here xl = and the factor 27r in front of the 
integration on the r.h.s. comes from the phase integration 
over j/l- Performing the integration over yn first, we have 



F(T K ,k, xh,0) 



T H . (27r) 4 (T H ) 2 m 
~- l0g k 



F(T u , X u,0), 
(17) 



with F defined by 



-F(r H ,xH,o)/r H _ 



dze- 0H(z ' XH)/TH . 



(18) 



The first term on the r.h.s of Eq.(|l7|) is independent of 
Xh, while F is independent of k. Using the notation of 
Eq.©, we find from Eq.© that W h (xho -» Xhi) = 
F(T H , X m,0) - F(T h ,Xho,0) along B ^B H in Fig. |, 
and W H (xm -» Xho) = T(T h ,xho,0) - F{T H , X m,0) 
along Ch — >Co. These two cancel exactly: 
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HO 



Xhi) + Wn(xm -> Xho) = 0. 



(19) 



The actual time interval required to change \a between 
Xao and Xai is finite, say, toi- The irreversible work due 
to this finiteness has been shown to be ©(ioiV 1 ) quite 
generally Q. Thus the irreversible work associated with 
the process in which Xa is changed between Xao and Xai 
can be made as small as we wish by making the timescale 
of operation sufficiently long. 

For later use, we now also estimate the heat exchanged 
upon the operation of the couplers. As we have shown 
above, the amount of work in the loose and tight regimes 
can be made arbitrarily small. Also, changes in the 
parameters Xa lead to only small changes of the inter- 
nal energy of the composite system. These facts to- 
gether with the energy balance principle (see Eq.(Q)) 
lead to the conclusion that the heat exchanged in these 
two regimes can be made as small as we wish. Next, 
the heat exchanged during the quasi-equilibrium pro- 
cesses with Xao < X < Xai is assessed as follows. 
From Eq.(|lj]) the ensemble average of the internal en- 
ergy of the composite system is given by Th + (1 — 

T h ^)F(T h ,xr,0)- If we define by (Q(B -» B H )> the 
average heat influx to the composite system during the 
quasi-equilibrium operation along Bo — >Bh, the condi- 
tion of energy balance, Eq.(|i"T|), yields (Q(B — > Bh)) = 
-T a ^[F{T n ,x^,0)-F(T sl ,xw,0)]- Ti ^ heat cancels 
exactly the average heat input (Q(Ch — * Co)) similarly 
defined along Ch — >Co: 



(Q(B -> B H )) + <Q(C H -> C )> = 0. 



(20) 



In the same manner, we can show the cancellation of both 
the work and the heat during the quasi-static part of the 
operation of coupler along Dq — »Dl and Al — >Aq. 



V. MATCHING THE 'TEMPERATURE' OF THE 
SYSTEM AND A HEAT BATH 

Here we study the meaning of the idea of matching 
the 'temperature' of the small system with that of a heat 
bath. For comparison, we note that this meaning is un- 
ambiguous for an isolated macroscopic thermodynamic 
system, for which the energy and the temperature are 
simultaneously well-defined quantities, and in order to 
realize a reversible Carnot cycle, the temperature of the 
system should be the same as that of the heat bath with 
which it makes contact. Contrastingly, for isolated small 
systems, the energy takes a definite value, while the tem- 
perature is not generally well-defined. We will show in 
this section that if the small system is a harmonic oscil- 
lator, the concept of the temperature is still useful, and 
reversibility can be obtained as in macroscopic systems. 
Discussion regarding the general case is given in § VII A . 



Suppose that a coupler is operated quasi-statically up 
to the edge of a loose regime (xl — Xlo along Al — > A 
or xh = Xho along C H C in Fig. 0). The energy of the 



oscillator in this situation fluctuates as a function of time 
and though the temporal fluctuation of the energy is very 
slow, it still obeys the canonical distribution at the tem- 
perature of the heat bath (Tl for Ao and Th for Co) up to 
a small error of 0($o) (^ T a ). By the definition of the 
loose regime, further weakening the connection results in 
a situation in which there is no appreciable exchange of 
energy between the system and the heat bath (see § | 
and pVj ) . Then, the complete disconnection leaves an iso- 
lated system whose energy is distributed according to the 
canonical distribution corresponding to the temperature 
of the heat bath. This is in fact true even if the small 
system is not a harmonic oscillator. 

For a harmonic oscillator, however, both the energy 
distribution in the canonical ensemble and the transfor- 
mation of the system's energy through the quasi-static 
adiabatic process have special features. The energy dis- 
tribution in the canonical ensemble at temperature T, 
P caxl (E;T) is independent of the parameter k: 



1 

— t 

T 



(21) 



(See Appendix A for a derivation.) Then, at Ao and Co, 
the energy of the oscillator is distributed according to 
P C an(E; Tl) and P can (E;Tn), respectively. If the oscilla- 
tor has a specific (initial) energy E and undergoes the 
quasi-static adiabatic process represented as Ao — >Bo or 
Co -^D in Fig. 0, its energy, E(k), changes so that the 
value J(E, k) given by HA3) remains constant [pTj: 



J(E(k),k) = 



E(k) 
2tt 



TO 

— = constant. 



(22) 



The relation ( |22| ) determines the change of the en- 
ergy distribution when the system undergoes a quasi- 
static adiabatic process through the change of k: For a 
change from k to k 1 , the altered distribution P'(E') must 

obey P can (E,T)dE = P'{E')dE' with E'/(2n^) = 

E/(2ny^). Thus we obtain the energy distribution of 
a canonical ensemble after the change in k, P'(E') = 
P caa (E',T) with V being defined by T/Vk = T'/y/k 1 . 
However, we note that this simple situation is due to the 
special nature of the harmo nic osc illator system. The 
general case is discussed in 



VII A. 



With these facts in mind, we can now characterize the 
condition for a quasi-equilibrium transition between adi- 
abatic processes and subsequent isothermal processes: 

(1) The energy distribution of the system before the con- 

nection with the heat bath must be that of a canon- 
ical ensemble. 

(2) The temperature characterizing this canonical en- 

semble must be the same as that of the heat bath 
in question. 

The reason is that, under these conditions, the system 
upon connection behaves statistically as if it had been in 
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contact with the heat bath for a long time. Note that the 
connection should be begun through a sufficiently weak 
interaction ~ $ (see § IV). In our case with the protocol 
described by Fig. ||, we require that T" = Th at Bo and 
T" = T"l at Do hold, respectively. Denoting the value of 
k at that between Aq and Al as Ua, that between So 
and £?h as ks, etc., the condition for a quasi-equilibrium 
connection to the heat bath is given explicitly as follows: 



■(W(A 



It, 



(23) 



VI. EFFICIENCY 

A. How is the Carnot limit approached? 

We now evaluate the maximal overall efficiency. We 
must take into account (i) the operation of the couplers, 
(ii) the isothermal processes, and (iii) the adiabatic pro- 
cesses. 

(i) We assume that by making the time in the loose 
and tight regimes sufficiently long, the intrinsically irre- 
versible work and heat flow can be made as small as we 
wish. The remaining part of the operation of couplers 
is assumed to be made under quasi-equilibrium condi- 
tions. The accompanying work and heat flow cancel ex- 
actly when summed over an infinite number of consec- 
utive connection and disconnection with the heat bath 
(see Eqs.(g||) and @). 

(ii) For the isothermal parts of the cycle, Bh -^Ch 
and Dl — *Al, we assume a quasi-static change of k. The 
accompanying work is then given using the general for- 
mula Eq.(|). For the part B H ->C H , F(T, a) in Eq.(§) 
is replaced by F(Tn, k, xh, 0) of Eq. (|l7|) , and the work 

done by the system is log ff^H ; which we denote by 
-W(Bn -> C H )- Similarly, for the part D L -^A L the 
work is -VF(D L -> A L ) = \ log (j^) . Then, the rela- 
tion (pa), we have 



VF(B H - Oh) - W(B L -» A L )) = Th - Tl log ( ^ 

2 V^c 



(24) 



(iii) For the adiabatic part of the cycle, Ao — >Bo and 
Co — >Do, we also assume a quasi-static change of k. The 
energy of the system then obeys the law (p^) and the 
amounts of work done by the system in the adiabatic 
processes — W(A — ► B ) and — FF(Co — » D ) are given 
by-W(A -> B ) = E(k A )(l-y/k^/kZ) and-IF(C -» 
D ) = E(k c ){l - y/fcp/fcc). As the energies E\ and Eq 
obey the distribution Eq.@) with T = T L and T = T H , 
respectively, their statistical averages are (£a) — Tl and 
(Ec) = Th [up to a small error of 0($ o )]- Using 
we then have 



(23) 




1 - 1 r 1 



= 0. 



(25) 



While we obtain this simple result in the present case, 
it is important to note that the cancellation of the con- 
tributions from the adiabatic processes on the average is 
not a generic feature of the Carnot cycle (consider, for 
example, non-ideal gases). 

The heat influx from the high temperature heat bath is 
evaluated as follows. While the work during the isother- 
mal quasi-equilibrium processes is a non-fluctuating 
quantity (see Eq.(||)), both the energy influx from the 
heat bath and the system's energy fluctuate subject to 
the constraint of energy balance described by Eq.(^). 
From Eqs.(|l7|) and ( |l8| ) we can show that the average 
internal energy of the composite system with degrees of 
freedom {p, x, yn, y^} is independent of the parameter k. 
Therefore, the statistical average of the heat influx dur- 
ing the isothermal process Bh — > Ch, which we denote 
by (Q(Bh — > Ch)), satisfies 



= <Q(B H -» C H )) + W(B H - C H ) 



Thus we have 



(Q(B H 



Gh)) = t 1os U 



(26) 



(27) 



As we have seen in S IV, there is no net heat flow due 



to the quasi-static part of the operation of coupler (see 
Eq. (fzol) ) , while the heat transfer associated with the loose 
and tight regimes can be made as small as we wish. 

Collecting the above results, the maximal overall ef- 
ficiency ijmai of the cycles is reduced to the following 
formula: 



^7max — 

Then, using 



W{B H -> C H ) - TF(Dl -> A L ) 

(Q(B H -> C H )) 
2) and (|27|) we have 



-1 _ Tl 

?7max — 1 • 



(28) 



(29) 



We would like to stress that the attainment of this effi- 
ciency (whose expression is familiar from textbook treat- 
ments) is not due to the quasi-static operation of the 
whole system. In the situation we consider, we have 
seen that some parts of the cycle can never be carried 
out quasi-statically, due to the intrinsically irreversible 
operation of the couplers (§ IV), as well as the intrin- 



sic irreversibility resulting from the non-canonical en- 
ergy distribution of the systems caused by the adiabatic 
processes(§ 0). 



B. Statistics over a finite number of cycles 



The maximal efficiency Eq.(29|) obtained above repre- 
sents exclusively the ratio of the total work done by the 



8 



system to the total energy influx from the high temper- 
ature heat bath through infinite number of cycles. Here 
we consider the efficiency for a single cycle, r]i oc , which 
can be written as 



??loc 



(30) 



with 



-8 W = -W(A Q B ) - W(C Q 



D n 



and 



5q = {Q(Bo^B h )+Q(C h ^C )} 

Q(B H -C H )-f log (|) 



(31) 



We first note several properties of ?7i oc . 

1. The deviations Sw and Sq do not vanish, even in 
the quasi-equilibrium limit, since the system continues 
to exchange energy with a heat bath until the moment 
that it is disconnected from the heat bath. 

2. If we choose the initial point of an individual cycle 
to be somewhere between Dl and Al, then the values of 
V\oc — (vioc) for different cycles are statistically indepen- 
dent. In fact, the statistical deviations of W^Ao — > Bo) 
and W^Co — > D ) are mutually uncorrelated because of 
the intervening isothermal Markov processes Bh — » Ch 
and D L -> A L , while W(A -> B ) and Q(B -> B H ) are 
statistically correlated through the shared point Bo, as 
are Q(Ch — > Co) and W(Co — » D ) through the point 
C . 

o 

3. One can define the 'excess output', — W, by 



W 



(V\oc - 

-S w 



?7max) 



(32) 



A positive value of — W implies that we happened to get 
more work than that expected from the Carnot maximal 
efficiency (i.e., — Sw > VmaxSq). Such a situation can 
result through fluctuations, and it is not in contradiction 
with the second law of thermodynamics. We may then, 
however, ask how many cycles on average we must carry 
out before we first obtain a cumulative excess output, 

n ° ° 

— w n = J2i=i(~ Wi), where — Wi is the excess output 
of the z-th cycle and n is the total number of consecutive 
cycles. The point of this question can be understood in 
terms of the following apparent paradox: Suppose one 

o 

monitors — w n as a function of n and stops when it be- 
comes positive for the first time. If one could repeat 
such a procedure of monitor-and-stop indefinitely many 
times, one could construct a perpetual machine of the 
second kind. This, of course, would be in contradiction 
with the second law of thermodynamics. A pitfall of this 
false argument is that, although for a given sequence of 



cycles, the condition — w n > will be satisfied at some 
finite n with probability 1, the average, over separate se- 

o 

quences of the smallest value of n with positive — w n 
is divergent. This fact is closely related to the fact that 
the one-dimensional random walk is 'null-recurrent' (see 
Appendix B). 



VII. DISCUSSION 

A. Irreversibility resulting from contact with a heat 

bath 

In § [v| we have used the fact that for the harmonic 
oscillator system, as a result of the quasi-static adiabatic 
process, the energy changes in such a manner that the 
energy distribution remains in canonical form, with sim- 
ply a change of the temperature, T — > T'. However, the 
harmonic oscillator represents a special system, and this 
is not generically the case with any Hamilton. More gen- 
erally, the energy distribution P can (E, T) is distorted into 
some non-canonical form, P'(E), as a result of the quasi- 
static adiabatic process. When an ensemble of systems 
following the distribution P'{E) are brought into (weak) 
contact with a heat bath of arbitrary temperature T' , the 
energy distribution irreversibly relaxes to the canonical 
form P can (E, T"). This is the case even if T 1 is chosen so 
that / EP'{E)dE = J EP can (E, T')dE, i.e. even in the 
case that no net heat is transferred on the average from 
the bath to the system. The relevance of this irreversible 
relaxation to the energetics of small systems requires fur- 
ther scrutiny. This will be discussed in more detail in a 
separate paper O ], 



B. Irreversible adiabatic process 

The adiabatic process in the Carnot cycle is a mechan- 
ical process. The ergodic invariant theorem jl3| tells us 
that under quasi-static and adiabatic change of a sys- 
tem parameter, say a, by a finite amount, the phase vol- 
ume enclosed by the energy surface define d by the sys- 
tem's energy at each moment, J(E, a) (see (A.2) for defi- 
nition), remains constant. The theorem does not assume 
the thermodynamic limit nor the presence or absence of 
chaotic trajectories. Contrastingly, for a non-quasi-static 
process J(E, a) can either increase or decrease, depend- 
ing on both the nature of the change of a and the initial 
conditions of the system. 

In the context of the present paper, however, it is most 
meaningful to confine ourselves to only 'macroscopic' ex- 
ternal operations, excluding 'demonic' ones which depend 
on detailed information of the system. More precisely, we 
focus on an unprejudiced choice of the initial conditions 
among those with a given energy, and also focus only 
on statistical averages of the energy, rather than con- 
sider particular results obtained from particular initial 
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conditions. Sato [[l4| has recently studied a harmonic os- 
cillator under a time-dependent force, mx = —x + a(t), 
as the simplest non-trivial example of a system with only 
macroscopic external operations. Here, the change oia(i) 
amounts to a horizontal displacement of the potential. 
He showed analytically, as one can easily confirm, that 
for an arbitrary function a(t), the energy of the oscillator, 
^x 2 + |(x — a) 2 , is strictly non-decreasing if the aver- 
age is taken with respect to the initial condition over all 
initial conditions represented by states with a given en- 
ergy, i.e., over a micro-canonical ensemble. Only in the 
limit of a quasi-static process — > 0) is the energy 
unchanged. 

This example demonstrates the irreversibility of a 
mechanical system of non-macroscopic size with prop- 
erly defined macroscopic operation. A recent numerical 
work | fl5f investigating a harmonic oscillator with time- 
dependent spring constant, mx = —k(t)x, reveals the 
same phenomena when k(t) is constrained to return to 
its initial value. In the present context of the analysis of 
the efficiency of Carnot cycle (§ VI), these findings are 
both natural and important, since, if the case were differ- 
ent, one could find functional form for k(t) for which the 
adiabatic work on the system would be less than what 
we expect for a quasi-static process, and the whole cycle 
could be used to construct a perpetual machine of the 
second kind. (Note that in the analysis of § |Vl| we have 
excluded only marginally the existence of such a perpet- 
ual machine if the loss due to the other sources is made 
arbitrarily small.) 

It is desirable to obtain a general proof (or counter- 
evidence) of the irreversibility resulting from non-quasi- 
static processes. A related analysis using path probabil- 
ities has been performed for chaotic systems 16 1. How- 



ever, we suspect that the essential mechanism of the irre- 
versibility related to the characterization of macroscopic 
operators, which are ignorant of the initial microscopic 
state of the system, can be elucidated without resort to 
chaotic statistics. It is also a future problem to scruti- 
nize the case in which the topology of the energy contour 
surface in the phase space (Ha = E) changes at some 
parameter value, say a c . In such cases, quasi-static pro- 
cesses cannot be extended across a c jl7[ . 



C. Control of processes by the system itself 

As in the case of the ordinary macroscopic Carnot cy- 
cle, we have introduced control parameters, {k, xn, Xl}- 
We assumed that the values of these parameters arc 
changed by some external agent whose dynamics are ex- 
ternal to the equation of motion of the system. 

In fact, however, there are many 'self-controlled' en- 
ergy transducers which contain their own control sys- 
tems. In such cases, the identification of the control 
system is more or less a matter of interpretation. In the 
macroscopic world, DC electric motors and steam engines 



are examples, while motor proteins, such as myosins, ki- 
nesins and dyneins, etc., are microscopic examples. The- 
oretically, the so-called Feynman ratchet and pawl sys- 
tem H has been proposed as a microscopic energy trans- 
ducer working by itself between hot and cool heat baths. 
In this model, the role of the control system is played ei- 
ther by the pawl or by the ratchet, depending on which of 
these two is in direct contact with the cool heat bath. The 
stochastic energetics of this model have been analyzed 
P,^8[. Butticker's model jl9| is another self-controlled 
microscopic transducer. In this model a massive parti- 
cle moves while in contact with a heat bath of position- 
dependent temperature, T(x) = Th or T\,. In this model, 
the inertia of the particle serves to switch the particle's 
environment from T = Th to T = Tl, or vice versa. The 
stochastic energetics of this model have also been ana- 
lyzed 0,^l| • Some people have claimed that the Carnot 
limiting efficiency rj max = 1 — ^ can be attained in Feyn- 
man's ratchet and pawl system (see || and p^| ) and in 
Butticker's model (see [p3[ ). With the exception of the 
original work by Feynman , where no implementation 
details are given, these studies introduced into their anal- 
yses some 'gate' mechanism. The study of the energetics 
of such systems, including the action of these gates, has 
not yet been made. 
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APPENDIX A: DERIVATION OF (21) 

For a general Hamiltonian TL a with a parameter a, 
the energy distribution P™£ (E; T) corresponding to the 
canonical ensemble at temperature T is 



P^(E;T,a) = W(E,a)e^- 



(Al) 



with 



W(E,a) 



dJ(E,a) 
dE ' 



J(E, a) = / dT, 



(A2) 



e T 
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where J dT denotes the phase integral. Here, J, or S = 
log J, is an adiabatic invariant. 

In the text, 7i a is that of an isolated harmonic oscil- 
lator, + ^|-, and we take its spring constant k as a. 
The calculation of J(E, k) is straightforward, yielding 



. . E pm 



(A3) 



W(E, a) is, therefore, independent of E. Thus from (Al) 
we reach ( Blf ) . In general, however, W(E,a) depends on 
E, and P]j^~{E; T) is not simply an exponential ~ e~ E/ " T . 
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APPENDIX D. NULL-RECCURENCB 



PROPERTY 

o 

As {— Wi} are statistically independent of each other, 

o 

— w n constitutes a one-dimensional discrete random 

o 

walk. To simplify the argument we assume that — Wi 
takes only the values ±1 randomly. If we denote by fa n 
the probability that at the (2n — l)-th step that the ran- 
dom walker comes to the position +1 for the first time, 
it is known that 



f%n — 



1 / 2n 

n2 2n+l I n 



1 



47T7J 3 / 2 



The fact that fc n is normalized (2n=i f 2n = ■"•) i m P ncs 
that this event occurs with probability 1 at some n. On 
the other hand, it is also true that 

oo 

V72n - l)/ 2n = oo. 



which is referred to as the null-recurrence property. Thus 
if we are to wait until the position of the walker becomes 
positive for the M-th time, with M > 1, then the 'waiting 
time' is, on the average, infinite. 
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